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ABSTRACT 

We  study  time  delay  estimation  (TDE)  on  parallel  channels  with  flat 
fading.  Several  models  for  the  channel  gains  are  considered,  and  for 
each  case  we  present  the  the  maximum  likelihood  estimator  (MLE), 
the  Cramer-Rao  bound  (CRB),  and  the  Ziv-Zakai  bound  (ZZB).  The 
bounds  facilitate  an  analysis  of  the  effects  of  fading  and  diversity  on 
TDE  accuracy  over  parallel  channels.  Computer  simulations  of  the 
mean-squared  error  of  the  MLEs  confirm  the  validity  of  the  bounds. 

Index  Terms —  Delay  estimation,  fading  channels,  maximum 
likelihood  estimation,  error  analysis,  diversity  methods. 

1.  INTRODUCTION 

Time  delay  estimation  (TDE)  has  been  studied  extensively  for  sev¬ 
eral  decades,  e.g.,  see  [1],  with  most  of  the  attention  focused  on  sig¬ 
nals  received  over  a  single  channel.  In  this  paper,  we  study  the  prob¬ 
lem  of  estimating  a  time  delay  (TD)  parameter  based  on  processing 
signals  received  on  multiple,  parallel  channels.  An  example  of  TDE 
on  parallel  channels  is  a  waveform  containing  multiple  frequency 
subbands  that  is  received  through  a  frequency-selective  channel.  The 
channel  may  be  known  or  unknown,  as  well  as  deterministic  or  ran¬ 
domly  fading.  The  subbands  may  be  viewed  as  parallel  channels, 
and  the  objective  is  to  jointly  process  the  signals  on  each  channel  to 
estimate  the  (common)  TD  parameter.  If  the  parallel  channels  in¬ 
clude  random  fading,  then  interesting  questions  include  an  analysis 
of  diversity  gain  with  respect  to  TDE  accuracy,  and  tradeoffs  be¬ 
tween  signal  energy  per  channel  and  the  number  of  channels.  TDE 
on  parallel  channels  also  arises  with  a  frequency-hopping  waveform 
in  which  multiple  hops  are  processed  to  estimate  the  TD  [2], 

In  this  paper,  we  formulate  a  model  for  TDE  on  parallel  chan¬ 
nels  in  Section  2.  Each  channel  is  modeled  as  frequency  nonselective 
(flat),  so  it  is  characterized  by  a  complex  gain.  We  consider  several 
models  for  the  channel  gain,  including  deterministic  (known  and  un¬ 
known)  and  random  (Rayleigh  fading).  In  Section  3,  each  channel 
model  is  analyzed,  and  we  present  the  maximum-likelihood  estima¬ 
tor  (MLE),  Cramer-Rao  bound  (CRB),  and  Ziv-Zakai  bound  (ZZB) 
for  the  TD  parameter.  Section  4  contains  Monte  Carlo  simulation  re¬ 
sults  that  compare  the  mean-squared  error  (MSE)  of  the  MLEs  to  the 
bounds.  We  note  that  bounds  for  TDE  on  a  convolutive  (frequency 
selective)  channel  have  been  developed  recently  in  [3]. 


The  Si(t)  are  known  waveforms,  rn(t)  are  complex,  AWGN  pro¬ 
cesses  with  zero  mean  and  two-sided  PSD  J\f0,  and  each  7;  is  a  com¬ 
plex  scalar  representing  the  gain  of  the  channel.  We  consider  five 
models  for  the  vector  of  complex  channel  gains,  7. 

(1)  7  is  known  and  deterministic. 

(2)  7  is  unknown  and  deterministic. 

(3  )  Each  7;  is  a  complex,  circular,  Gaussian  random  variable  with 
zero  mean  and  variance  -E{|7*|2}  =  <x2,  independent  for 
i  =  1, . . . ,  N.  This  corresponds  to  Rayleigh  fading,  denoted 
by  7  ~  CN  (0,  <r2  I)  .  The  results  in  this  paper  are  identical 
whether  is  modeled  as  a  known  or  unknown  parameter. 

(1A)  Case  (1)  averaged  over  the  Rayleigh  fading  distribution,  so 
7  ~  CN  (0,  cr2  I) .  This  corresponds  to  a  fading  channel  and 
a  receiver  that  has  perfect  knowledge  of  7,  so  the  TDE  is  esti¬ 
mated  with  a  coherent  combination  of  the  diversity  channels. 

(2A)  Case  (2)  averaged  over  7  ~  CN  (0,  cr2  I) .  This  corresponds 
to  (imperfect)  estimation  of  7  on  each  realization,  and  then 
averaging  over  the  Rayleigh  fading  distribution. 

Case  3  is  different  from  case  2A  in  that  7  is  not  estimated  in  case  3 
since  it  is  modeled  as  a  random  vector. 

The  probability  density  function  (pdf)  for  the  model  (1)  is 
required  for  two  cases:  the  conditional  pdf,  pc  (R\  y;  t),  where 
7  is  a  fixed  vector,  and  the  unconditional  pdf,  pu  (R  \  r)  = 
Ey  {pc  (R  |  7;  t)},  that  is  averaged  over  7  ~  CN  (0,  <x2  J) .  The 
signal  autocorrelation  functions  are  defined  as 

Pi(0  =  J  Si(t.~  0*  «»(*)  dt,  i  =  l,...,N,  (2) 

where  *  denotes  complex  conjugate  and  the  limits  on  all  integrals  are 
(—00,00).  The  coherent  and  noncoherent  matched  filters  applied  to 
the  signal  received  on  channel  i  are  defined  as  follows, 
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2.  SIGNAL  MODEL 

We  model  the  complex-valued  signals  received  on  N  channels  as 

r»(f)  =  7»  Si{t  -  t)  +  ru(t),  i=l,...,N.  (1) 


Let  77  be  a  vector  representation  of  17(f),  and  define  R  =  [n, . . . ,  rjv]. 
Then  the  conditional  pdf  for  R  has  the  following  form,  where  factors 
independent  of  7,  r  are  suppressed: 

Pc  {R  |  7;  t)  oc  nf=i  exp{^  [2LCOH(r)  -  M2M0)]}  •  (5) 
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The  unconditional  pdf  is  obtained  by  observing  that  7  ~  CN  (0,  erf  i)  For  case  1,  the  MLE  is  the  value  of  r  that  maximizes  the  LL  in  (1 1) 
implies  that  r;  ~  CN  (0,  S,),  where  the  covariance  matrix  is  when  7  is  known,  so 


=t7  sSi(T)Si{T)H  +  Mol 
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where  Sj(r)  is  the  vector  representation  of  Si(t  —  r)  and  H  is  the 
conjugate-transpose  operation.  Then,  ignoring  terms  and  factors  that 
are  independent  of  r,  the  unconditional  pdf  is  proportional  to 


pn  (R  |t)  oc  nf=i  exP 


(r)2  (8) 
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We  make  the  following  three  assumptions. 

A1  The  signal  autocorrelation  functions  in  (2)  are  the  same  on  each 
channel,  p*(£)  =  p(f),i  =  1,  •  •  • ,  N,  so  the  signal  energy  is 


Pi( 0)  =  J  M*)|2  dt  =  p(0),  i  =  l,...,N. 


(9) 


A2  The  signals  have  the  property  f  Si(t)  Si(t)*  dt  =  0  ,  where 
Si{t)  =  £si(t). 

A3  The  mean-squared  signal  bandwidth  is  the  same  on  each  channel 
and  is  denoted  by  Bs  Hz,  with  definition 


fi  =argmaxZCOH(0.  (15) 

For  case  2,  7  is  an  unknown,  deterministic  parameter,  so  the  MLE 
requires  the  joint  maximization  of  the  LL  in  (1 1)  with  respect  to  r 
and  7.  For  a  given  TDE  estimate  r,  the  MLE  of  each  7 is 

7*  =  J  Si(t  -  ?)*  n(t)  dt,  i  =  l,...,N.  (16) 

The  estimates  7;  in  (16)  are  substituted  for  7  in  (1 1),  yielding 

^NONCOH/^n 

T2=argmaxZ  (£).  (17) 

For  case  3,  7  ~  CN  (0,  a2a  J)  so  the  MLE  for  r  is  the  value  that 
maximizes  the  unconditional  LL  in  (12),  which  is  identical  to  (17): 

^NONCOH/^n  /10n 

r3  =  arg  max  Z  (£)■  (18) 

For  cases  1A  and  2 A,  the  MLEs  are  given  by  fi  in  (15)  and  ?2  in 
(17),  respectively.  The  MLE  performance  is  different  in  cases  1A 
and  2A  (compared  with  cases  1  and  2  in  which  7  is  fixed)  due  to 
averaging  over  realizations  of  values  for  7  ~  CN  (0,  of,  J) .  In  Ta¬ 
ble  1,  “Coh  MF”  refers  to  (13)  and  “NonCoh  MF”  refers  to  (14). 


Bi  = 


r  i*wr  dt=  [f2\sm2df  (10) 
J  P( 0)  (27t)2  J  p( 0)  (  ’ 


p( 0)  (27r) 

where  Si(f)  is  the  Fourier  transform  of  s,  (t). 

Then  the  log-likelihood  functions  corresponding  to  (5)  and  (8)  are 
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3.  TDE  ESTIMATORS  AND  BOUNDS 


In  this  section,  the  MLEs,  CRBs,  and  ZZBs  are  presented  for  the 
five  channel  model  cases.  Before  presenting  the  details,  a  summary 
is  provided  in  Table  1.  In  cases  1  and  1A,  the  MLE  is  a  sum  of  co¬ 
herent  matched  filters  (MFs)  because  7  is  known.  In  cases  2,  3,  and 
2A,  the  MLE  is  a  sum  of  noncoherent  matched  filters.  Although  the 
MLEs  are  identical  for  several  cases  in  Table  1,  the  performance  of 
the  MLE  varies  from  case  to  case,  except  that  the  performance  is  the 
same  in  cases  2A  and  3.  The  CRBs  for  cases  1,  2,  and  3  are  gener¬ 
ally  distinct.  However,  for  the  known  signal  waveforms  considered 
here  with  assumption  A2,  the  r  and  7  parameters  are  decoupled  in 
the  Fisher  Information  Matrix  (FIM),  so  CRB2  =  CRBi.  The  CRB 
is  not  defined  for  cases  1A  and  2A,  but  the  so-called  modified  CRB 
(MCRB)  [4,  5]  and  asymptotic  CRB  (ACRB)  [6]  definitions  are  sim¬ 
ilar  to  these  cases.  The  ZZB  is  unique  in  four  of  the  five  channel 
model  cases,  and  the  ZZB  is  tractable  in  the  four  distinct  cases. 


3.2.  Cramer-Rao  bounds 


Next  we  consider  the  CRBs.  In  general,  let  us  denote  the  determin¬ 
istic  parameters  by  the  vector  ©  and  the  LL  function  by  £(R  |  ©). 
For  cases  1,  2,  and  3,  r*  is  a  complex,  Gaussian  random  vector, 
ri  ~  CN(/Xj,  Cf),  independent  for  j  =  1, . . . ,  N,  so  the  Fisher 
information  matrix  (FIM)  elements  are  given  by  [7] 


[J(0)]m,n  =  E,=i  {trace  [c4  1 
~  9  m  H 
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For  cases  1  and  2,  pi  =  7  iS-fr)  and  C,  =  M0I,  with  ©  =  [r]  for 
case  1  and  ©  =  [Re  (7) ,  Im  (7) ,  r]  for  case  2.  For  case  3,  pi  =  0 
and  Cj  =  Si  in  (6),  with  ©  =  [r]. 

The  CRB  expressions  are  unified  if  we  define  the  average  SNR 
per  channel  in  (20)  for  the  deterministic  cases  1  and  2,  and  the  mean 
SNR  per  channel  for  cases  1A,  2A,  and  3  in  (21): 


SNRde,(7)  =  (p(0)/iV)£f=i^ 


SNR  = 


p(0)g{M2} 

Mo 


p( 0)  P’s 
Mo 


(20) 

E-,  {SNRdct  (7)}  •  (21) 


It  can  be  shown  that  the  FIM  for  case  2  is  diagonal,  so  the  CRB 
for  r  is  identical  in  cases  1  and  2: 


CRBi  (r  |  7)  =  CRB2  = 


1 

2  (27 tBs)2  N  SNRdct  (7) ' 


(22) 


3.1.  Maximum  likelihood  estimators 

The  MLEs  are  sums  of  coherent  and  noncoherent  matched  filters, 


The  notation  on  the  left  side  of  (22)  emphasizes  that  the  CRB  de¬ 
pends  on  the  channel  gains,  7.  The  FIM  for  case  3  is  obtained  from 
(19)  with  pi  =  0,  C i  =  Si  in  (6),  and  ©  =  [r],  yielding: 
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1 

2 

3 

1A 

2A 

MLE 

CRB 

ZZB 

Coh  MF 
CRBi 
ZZBi 

NonCoh  MF 
CRB2  =  CRBi 

zzb2 

NonCoh  MF 

crb3 

zzb3 

Coh  MF 
MCRB 
ZZBi  a 

NonCoh  MF 
ACRB  =  MCRB 
ZZB2  a  =  zzb3 

Table  1.  Relations  between  the  MLEs,  CRBs,  and  ZZBs  for  each  channel  model. 


The  CRB  in  (23)  is  the  “true”  CRB  for  the  Rayleigh  fading  chan¬ 
nel  model.  The  derivation  of  (23)  is  tractable,  but  it  requires  sig¬ 
nificantly  more  computation  than  the  CRB  in  (22)  in  which  7  is  a 
deterministic  parameter.  A  number  of  bounds  that  are  looser  than 
the  CRB  have  been  studied  for  models  with  random  nuisance  pa¬ 
rameters,  such  as  the  modified  CRB  (MCRB),  hybrid  CRB  (HCRB), 
asymptotic  CRB  (ACRB),  and  others  [4,  5,  6],  These  looser  bounds 
begin  with  a  FIM  in  which  7  is  modeled  as  a  deterministic  param¬ 
eter,  and  then  an  averaging  operation  is  performed  over  7  on  some 
function  of  the  FIM.  The  CRB  is  not  defined  for  channel  models  1A 
and  2A  in  Table  1 ,  but  the  MCRB  and  ACRB  are  closely  related  to 
cases  1 A  and  2 A,  respectively,  and  have  the  form 


Pe  (a,  a+0)  denote  the  minimum  probability  of  error  in  deciding  be¬ 
tween  Ho  and  Hi  for  particular  values  of  a,  a  +  9.  The  Pe(a,  a +  9) 
is  derived  from  a  likelihood  ratio  test  (LRT),  so  it  depends  on  the 
model  for  the  channel  gain  vector,  7.  The  conditional  log-likelihood 
(LL)  in  (1 1)  is  used  to  find  Pe  for  channel  models  1  and  1A,  with  7 
fixed  in  case  1  and  averaged  over  7  in  case  1  A.  For  case  2,  a  general¬ 
ized  LRT  formed  with  ML  estimates  of  the  channel  gain  parameters 
in  ( 16)  substituted  into  (11)  reduces  to  a  LRT  based  on  (12),  with  7 
fixed.  Case  2 A  includes  subsequent  averaging  over  7.  The  Pe  for 
case  3  is  based  on  the  unconditional  LL  in  (12),  and  is  found  to  be 
identical  to  case  2A.  The  ZZB  for  each  case  is  obtained  by  using  the 
corresponding  Pe  in  the  following  expression. 


CRBia  (?)  «  MCRB  (?)  = 
CRB2a  (?)  «  ACRB  (?)  = 


1 
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(24) 
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Note  from  (23),  (24),  (25)  that  CRB3  (?)  >  MCRB  (?)  =  ACRB  (?) 
and  that  the  three  bounds  coincide  when  SNR  3>  1. 

The  CRBs  in  (22),  (24),  (25)  are  identical  if  we  set  SNRdc  (7)  = 
SNR  in  the  deterministic  and  random  channel  models,  and  (23)  has 
the  same  form  when  SNR  3>  1.  Thus  the  CRBs  depend  on  the  total 
signal  power  over  the  N  channels,  and  the  CRB  analysis  does  not 
reveal  any  diversity  advantage  if  more  channels  are  used  with  pro¬ 
portionately  less  signal  power  per  channel.  We  will  show  in  the  fol¬ 
lowing  subsection  that  the  Ziv-Zakai  bounds  are  quite  sensitive  to  the 
channel  model,  and  greater  diversity  (larger  N)  provides  significant 
improvement  in  the  threshold  SNR  at  which  the  MLE  performance 
is  equal  to  the  CRB. 


3.3.  Ziv-Zakai  bounds 


1  r 
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where  V  [-]  is  a  nonincreasing  function  that  fills  the  valleys  of  the 
bracketed  function,  and  Pe(a,  a  +  9)  =  Pe(9)  is  independent  of  a. 

The  Pe  expressions  for  each  case  are  obtained  with  the  aid  of 
expressions  from  [11,  pp.  882-886]  and  [12,  p.  319  and  pp.  619 
624],  First,  we  define 
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The  CRB  is  a  tight  bound  on  the  MLE  performance  only  when  the 
errors  are  small.  As  the  errors  get  larger,  a  threshold  behavior  arises 
from  ambiguities  that  are  particular  to  the  signal  and  its  correlation. 
Several  approaches  have  been  used  to  develop  bounds  tighter  than 
the  CRB.  Ziv  and  Zakai  developed  an  approach  based  on  hypothesis 
testing  [8],  and  improvements  were  subsequently  derived  [9,  10]. 
In  this  section,  we  outline  the  approach  used  to  find  the  improved 
ZZB  for  the  model  in  ( 1 )  and  present  four  distinct  ZZB  results,  as 
summarized  in  Table  1 .  The  detailed  derivations  are  omitted  due  to 
space  limitations. 

The  ZZB  is  derived  from  the  following  hypothesis  test: 
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generalized  ith  order  Marcum  Q-function  [12] 
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Then  the  Pe  expressions  for  cases  1,  2,  1A,  and  2A  =  3  are 


H0  :  n{t)  =  s,(t  -  a)  +  ni(t),  i  =  l,...,N  (26) 

Hi:  n(t)  =  74  Si  (t  -  (a  +  9))  +  rn(t),  i  =  l,...,N.  (27) 

The  hypotheses  are  equally  likely,  r  is  modeled  as  a  uniform  ran¬ 
dom  variable  on  the  interval  [—  D/2,  D/2],  which  represents  a  priori 
knowledge  about  the  range  of  possible  values  for  the  TD  parameter. 
Therefore  in  (26),  (27),  9  >  0  and  a,  (a  +  9)  e  [-D/2,  D/2 ].  Let 


Pe,  1  (0  1  7 )  =  Q\  Jn-  SNRdc,  (7)  •  (1  - 

Re[p(0)]V 

)  (32) 

m  ), 

Pe, 2  ( 9 )  =  S  (a(9, 7,  N),b(0, 7,  N),  N ) 

(33) 

Pe,lA(9)=R{p(0),N) 

(34) 

Pe,3  (9)  =  Pe,2A  (0)  =  R  {v{9) ,  N)  . 

(35) 
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SQUARE  ROOT  OF  ZZB,  CRB,  &  SIMULATED  MSE:  N  =  1  CHANNEL  SQUARE  ROOT  OF  ZZB,  CRB,  &  SIMULATED  MSE:  N  =  5  CHANNELS 


Fig.  1.  Comparison  of  CRB,  ZZB,  and  MSE  for  N  =  1  and  N  =  5  channels. 


Note  that  Pe,iA  and  Pe, 3  =  Pe,2A  have  similar  functional 
forms,  so  from  (30)  and  (3 1)  we  can  define  an  “SNR  penalty”, 

SNR3  =  SNR2A  =  SNRla  ■  2  ■  1  ~  Re  ■  (36) 

1  -  |p(6')/p(o)| 

Case  1A  assumes  that  the  receiver  has  perfect  knowledge  of  the 
channel  gains,  so  the  factor  on  the  right  side  of  (36)  may  be  viewed 
as  the  additional  SNR  that  is  required  in  cases  2A  and  3  to  achieve 
the  same  Pe  for  a  given  9  as  case  1A.  This  SNR  penalty  does  not 
translate  directly  to  the  ZZB  due  to  the  integration  over  9  in  (28). 

It  is  possible  to  obtain  simplified  expressions  for  (32)-(35)  at 
high  SNR,  leading  to  an  analytical  characterization  of  the  SNR- 
threshold  behavior  of  TDE  on  parallel  channels.  The  details  of  this 
analysis  will  be  elaborated  elsewhere,  but  an  interesting  conclusion 
is  as  follows  for  the  cases  with  random  fading  (1 A  and  2A=3).  If  the 
total  signal  power  is  held  fixed  as  N  is  increased,  so  that  N  ■  SNR 
remains  fixed  as  N  increases,  then  as  long  as  the  SNR  per  channel  is 

1,  .Pe.TA  and  Pe, 3  =  Pe,2A  decrease  as  N  increases.  Therefore 
increased  diversity  reduces  the  SNR  threshold  for  TDE  on  fading 
channels,  while  the  increased  diversity  has  no  effect  on  the  CRBs  in 
(22)-(25)  if  N  •  SNR  is  fixed. 

4.  NUMERICAL  EXAMPLE  AND  SIMULATION 

We  present  a  numerical  evaluation  of  the  bounds  and  compare  with 
the  simulated  mean-squared  error  (MSE)  of  the  MLEs.  The  signal 
on  each  channel  is  a  square-root,  raised-cosine  pulse  with  0  excess 
bandwidth,  period  10-3  sec,  and  unit  energy.  The  MSEs  are  com¬ 
puted  based  on  a  minimum  of  10,000  Monte  Carlo  runs  at  each  SNR, 
with  22,000  runs  for  SNRs  in  the  threshold  region. 

Figure  1  shows  the  bounds  and  simulated  root-MSE  for  N  =  1 
and  N  =  5  channels  for  cases  1  (blue),  2  (green),  1A  (red),  and  3 
(black).  Note  that  for  N  =  1  channel  (no  diversity),  the  ZZBs  with 
fading  (1A  and  2A  =  3)  are  significantly  larger  than  the  CRB,  and 
the  CRB  is  not  achievable  an  any  SNR.  For  N  —  5  channels,  the 
ZZBs  converge  to  the  CRBs  when  the  SNR  is  exceeds  a  threshold. 
For  all  cases,  the  SNR  thresholds  of  the  ZZB  and  MSE  are  similar. 
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